Quasi-stationarity of Discrete-time Markov Chains with Drift to Infinity

نویسنده

  • PAULINE COOLEN-SCHRIJNER
چکیده

We consider a discrete-time Markov chain on the non-negative integers with drift to innnity and study the limiting behaviour of the state probabilities conditioned on not having left state 0 for the last time. Using a transformation, we obtain a dual Markov chain with an absorbing state such that absorption occurs with probability 1. We prove that the state probabilities of the original chain conditioned on not having left state 0 for the last time are equal to the state probabilities of its dual conditioned on non-absorption. This allows us to establish the simultaneous existence, and then equivalence, of their limiting conditional distributions. Although a limiting conditional distribution for the dual chain is always a quasi-stationary distribution in the usual sense, a similar statement is not possible for the original chain.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Total Variation Cutoff in Birth-and-death Chains

The cutoff phenomenon describes a case where a Markov chain exhibits a sharp transition in its convergence to stationarity. In 1996, Diaconis surveyed this phenomenon, and asked how one could recognize its occurrence in families of finite ergodic Markov chains. In 2004, the third author noted that a necessary condition for cutoff in a family of reversible chains is that the product of the mixin...

متن کامل

Quasi-Stationary Distributions for Reducible Absorbing Markov Chains in Discrete Time

We consider discrete-time Markov chains with one coffin state and a finite set S of transient states, and are interested in the limiting behaviour of such a chain as time n tends to infinity, conditional on survival up to n. It is known that, when S is irreducible, the limiting conditional distribution of the chain equals the (unique) quasi-stationary distribution of the chain, while the latter...

متن کامل

Mixing Times for Uniformly Ergodic Markov Chains

Consider the class of discrete time, general state space Markov chains which satist)' a "'uniform ergodicity under sampling" condition. There are many ways to quantify the notion of "mixing time", i.e., time to approach stationarity from a worst initial state. We prove results asserting equivalence (up to universal constants) of different quantifications of mixing time. This work combines three...

متن کامل

Time Delay and Data Dropout Compensation in Networked Control Systems Using Extended Kalman Filter

In networked control systems, time delay and data dropout can degrade the performance of the control system and even destabilize the system. In the present paper, the Extended Kalman filter is employed to compensate the effects of time delay and data dropout in feedforward and feedback paths of networked control systems. In the proposed method, the extended Kalman filter is used as an observer ...

متن کامل

Quasi-stationarity distributions and diffusion models in population dynamics

In this paper, we study quasi-stationarity for a large class of Kolmogorov diffusions, that is, existence of a quasi-stationary distribution, conditional convergence to such a distribution, construction of a Q-process (process conditioned to be never extinct). The main novelty here is that we allow the drift to go to −∞ at the origin, and the diffusion to have an entrance boundary at +∞. These ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 1998